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DETAILED ACTION 

The response received on 9/30/2009 has been placed in the file and was 
considered by the examiner. An action on the merit follows. 

Response to Amendment 

1 . The amendments filed on 2009 September 22 have been fully considered. 
Response to these amendments is provided below. 

Summary of Amendment/ Arguments and Examiner's Response: 

2. The applicant has amended the claims to overcome a few rejections, and has 
also argued the prior art does not teach certain limitations. 

3. On page 24 of the arguments, the applicant argues that "First, Takei does not 
describe identifying one or more groups of pixels that correspond to a face. Takei only 
identifies flesh colors within digital images, but does not determine whether any 
identified flesh color pixels correspond to faces." 

4. The examiner disagrees. As the applicant describes, Takei teaches finding flesh 
colored pixels. These pixels correspond to a face (col. 9, lines 25-27). Therefore, by 
finding flesh colored pixels, Takei finds pixels corresponding to faces. 

5. Second, Takei does not describe one or more of sub-sampling and weighted 
sampling of the image, including reducing a number of pixels on which computations 
are performed. Takei describes sub-dividing a digital image into, e.g., twelve areas. 
However, computations are performed by Takei on all of the pixels in the image, In 
contrast, Applicants' invention as set forth at Applicants' amended claims 1-15, 22-33, 
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41-55, 63W3 and 81-112 requires reducing the number of pixels on which computations 
are performed by one or more of sub-sampling and weighted sampling, thereby 
providing more efficient methods. 

6. Takei does teach sub-sampling the image, including reducing a number of pixels 
on which computations are performed. First of all, as the applicant states, the digital 
image has 12 areas in which computations are performed. These 12 areas are part of a 
full area of the frame (fig. 6B). There exists an outside area in which the computations 
are not performed, since computations are performed on areas Y10Y6 and C1-C12 (col. 
9, lines 35-36) and as seen in fig. 6A-B, the peripheral area is not included. Thus, the 
amount of pixels in which computations are performed are reduced. 

7. Third, Takei does not detect faces in real-time or near real-time. As indicated 
above, Takei does not even detect faces. Moreover; the time and resource intensive 
processes described by Takei simply do not permit real-time nor near real-time 
performance. 

8. Takei does detect faces in real time, since Takei detects faces by finding flesh 
colored regions, as explained above. Furthermore, the processes of Takei must permit 
real-time performance because the purpose of exposure control is to maintain an ideal 
state at all times with the camera (col. 1 , lines 11-13); thus the processes must occur in 
the camera while it is operating in real-time. 

9. The applicant argues that none of the other references teach these features. 

10. The other references do not have to teach these features because, as explained 
above, Takei already teaches these features. 
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1 1. Lastly the applicant summarizes Takei as adjusting a detector where backlighting 
is determined to prevail. In contrast, the applicant's claims involve post-acquisition 
image processing or adjustment of values, and that the applicant's invention represents 
a different technological endeavor. 

12. Perhaps the invention of the applicant and the invention of Takei may be different 
inventions, but as of now, Takei meets the claimed limitations. It can also be argued 
that Takei involves post-acquisition image processing or adjustment of values, since the 
image that is obtained is processed after it is obtained and then the values are adjusted 
by the exposure control apparatus. Therefore, even the applicant's statement of the 
differences between the inventions does not distinguish the inventions from each other. 

Information Disclosure Statement 

1 3. The information disclosure statement filed 9/30/2009 fails to comply with 37 CFR 
1 .98(a)(2), which requires a legible copy of each cited foreign patent document; each 
non-patent literature publication or that portion which caused it to be listed; and all other 
information or that portion which caused it to be listed. It has been placed in the 
application file, but the information referred to therein has not been considered. The 
references that no copy can be found are lined through. 

Claim Objections 

14. The independent claims 1 , 23, 41 , 63, 85, 92, 99 and 1 06 are objected to 
because of the following informalities: The claims contain a clerical error, i.e. claim 1 
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contains a double and in the previously claimed step a. Appropriate correction is 
required. 

Claim Rejections - 35 USC § 102 

1 5. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

16. Claims 1 and 85 are rejected under 35 U.S.C. 102(b) as being unpatentable by 
U.S. Patent No. 5353058 (Takei). 

17. Regarding claim 1 , Takei discloses a method of generating on a processor-based 
digital image acquisition device one or more new digital still images using an original 
digitally-acquired still image including a face, comprising: using a processor (fig. 4) of 
the device in performing the following: (a) identifying one or more groups of pixels that 
correspond to a face within a foreground region of the original digitally-acquired still 
image by identifying which groups of pixels/ areas have flesh colored regions that 
correspond to a face within a foreground region (fig. 1 1 A, col. 9, lines 29-32) wherein 
the identifying comprises sub-sampling of the image including reducing a number of 
pixels on which computations are performed, by dividing/ subsampling the image into 12 
areas (col. 9, lines 29-31) and not including the area around the areas (fig. 6a-b) and 
wherein the identifying further comprises detecting the face in real time since the 
exposure control is done in the camera automatically and maintained throughout all 
times (col. 1 , lines 1 1 -1 5); (b) calculating a degree to which exposure of the face in the 
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foreground within said image differs from a desired exposure of said face by finding the 
correction signal that corrects the values to obtain the appropriate exposure (col. 9, 
lines 30-35) within said image, including determining that said face lacks the desired 
exposure as being shadowed or shot with back light or otherwise insufficiently 
illuminated during acquisition (col. 9, lines 30-31), (c) based on the identifying of the one 
or more groups of pixels that correspond to said face and on the degree as a result of 
the calculating, selecting a portion of the original still image for processing to include the 
one or more groups of pixels, the pixels of flesh color (col. 9, lines 40-60); and (d) 
automatically generating values of pixels of one new still image based on the selected 
portion in a manner which always includes the face within the one or more new still 
images which differ from the original digitally-acquired still image by including at least 
one group of pixels modified at least in luminance of the face, the pixels of the face, 
including applying a digital fill flash to add light and to boost the luminance of the face in 
the foreground, as compared with the one or more groups of pixels identified in the 
foreground of the original digitally-acquired still image, since the exposure of the face is 
compensated/ corrected when there is backlight, thus lightening the areas of the 
foreground/ face (col. 9, lines 40-60). 

18. Claim 85 is rejected for the same reasons as claim 1 . Thus, the arguments 
analogous to that presented above for claim 1 are equally applicable to claim 85. Claim 
85 distinguishes from claim 1 only in that claim 85 adds the limitation that the process is 
carried out an the portable digital camera. Takei teaches this feature, i.e. the apparatus 
is on a video camera (col. 1, lines 11-14). 
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Claim Rejections - 35 USC § 103 

1 9. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

20. Claims 23 and 92 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei, as applied to claims 1 and 85 above, and further in view of U.S. Patent 
Application Publication No. 20040095359 (Simon et al). 

Claims 23 and 92 are rejected for the same reasons as claims 1 and 85, 
respectively. Thus, the arguments analogous to that presented above for claims 1 and 
85 are equally applicable to claims 23 and 92. Claims 23 and 92 distinguishes from 
claims 1 and 85 only in that they automatically provide an option for generating new 
values. Simon et al teaches further this feature, i.e. providing options to the user for 
generating new values (fig. 1, step 102 and 104) 

Takei and Simon et al are combinable because they are from the same field of 
endeavor, i.e. processing facial images. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to automatically provide an option. 

The suggestion/motivation for doing so would have been to provide a more user- 
friendly system by allowing them to access their preferences. 
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Therefore, it would have been obvious to combine Takei with the option of Simon 
et al to obtain the invention as specified in claims 23 and 92. 

21 . Claims 41 and 99 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of U.S. Patent Application Publication No. 20010005222 
(Yamaguchi). 

22. Claims 41 and 99 are rejected for the same reasons as claims 1 and 85. Thus, 
the arguments analogous to that presented above for claims 1 and 85 are equally 
applicable to claims 41 and 99. Claims 41 and 99 distinguishes from claims 1 and 85 
only in that they are CRM claims instead of method claims. Yamaguchi teaches further 
this feature, i.e. that a method can be embodied on a CRM (col. 4, line 62- col. 5, line 
10); particularly a method that involves the adjustment of face data. 

Takei and Yamaguchi are combinable because they are from the same field of 
endeavor, i.e. facial image processing. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to embody the method on a CRM. 

The suggestion/motivation for doing so would have been to provide a well known, 
compact and thus user friendly means to carry out the method. 

Therefore, it would have been obvious to combine the method of Takei with the 
CRM of Yamaguchi to obtain the invention as specified in claims 41 and 99. 
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23. Claims 63 and 106 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Yamaguchi, as applied to claims 41 and 99 above, and further in 
view of and Simon 

24. Claims 63 and 106 are rejected for the same reasons as claims 41 and 99. 
Thus, the arguments analogous to that presented above for claims 41 and 99 are 
equally applicable to claims 63 and 106. Claims 63 and 106 distinguishes from claims 
41 and 99 only in that they automatically provide an option for generating new values. 
Simon et al teaches further this feature, i.e. providing options to the user for generating 
new values (fig. 1, step 102 and 104). 

Takei (as modified by Yamaguchi) and Simon et al are combinable because they 
are from the same field of endeavor, i.e. processing facial images. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to automatically provide an option. 

The suggestion/motivation for doing so would have been to provide a more user- 
friendly system by allowing them to access their preferences. 

Therefore, it would have been obvious to combine Takei (as modified by 
Yamaguchi) with the option of Simon et al to obtain the invention as specified in claims 
63 and 106. 



25. Claims 2-5, 42-45, 86-89, and 100-103 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Takei in view of Yamaguchi, and further in view of U.S. Patent 
No. 4970663 (Bedell et al). 
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26. Regarding claim 2, Takei discloses all of the claimed elements as set forth above 
and incorporated herein by reference. 

Takei does not disclose expressly (e) gradually displaying a transformation 
between said original image and the new image. 

Yamaguchi discloses when transforming images, displaying the original image 
(page 3, paragraph 48) and displaying the final image (fig. 1 1 , s234). Thus, Yamaguchi 
discloses displaying a transformation between these images since both images are 
displayed. 

Takei and Yamaguchi are combinable because they are from the same field of 
endeavor, i.e. processing facial images. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to display the transformation between images. 

The suggestion/ motivation for doing so would have been to provide a more user- 
friendly system by allowing the user to review the transformation. 

Takei (as modified by Yamaguchi) does not disclose expressly the gradual 
display of the transformation. 

Bedell et al discloses displaying another type of transformation between the 
images when disclosing that images can be dissolved from one image to another (col. 
4, lines 19-20). 

Takei (as modified by Yamaguchi) and Bedell et al are combinable because they 
are from the same field of endeavor, i.e. manipulating images. 
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At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to display a gradual transformation. 

The suggestion/motivation for doing so would have been to provide a more user 
friendly system by allowing the user a pleasing way to view the transformation. 

Therefore, it would have been obvious to combine the method of Takei with the 
display of both images of Yamaguchi and the gradual display of Bedell et al to obtain 
the invention as specified in claim 2. 

27. Regarding claim 3, Takei discloses adjusting parameters, the exposure 
parameters (col. 9, lines 35-40), of said transformation between the original image and 
the new image. Bedell discloses other parameters, as seen in the rejection for claim 4, 
below. 

28. Regarding claim 4, Bedell et al discloses that parameters of said transformation 
between images are being selected from a set of criteria including timing, the number of 
frames it takes to dissolve and blending, the blending of the frames as one frame 
dissolves into another (col. 4, lines 21-25). 

29. Regarding claim 5, Bedell et al discloses blending includes dissolving (col. 4, 
lines 19-20). 

30. Claims 42-45 are rejected for the same reasons as claims 2-5, respectively. 
Thus, the arguments analogous to that presented above for claims 2-5 are equally 
applicable to claims 42-45. Claims 42-45 distinguishes from claims 2-5 only in that they 
have different dependencies, both of which have been previously rejected. Therefore, 
prior art applies. 



Application/Control Number: 10/608,784 Page 12 

Art Unit: 2624 

31 . Claims 86-89 are rejected for the same reasons as claims 2-5, respectively. 
Thus, the arguments analogous to that presented above for claims 2-5 are equally 
applicable to claims 86-89. Claims 86-89 distinguishes from claims 2-5 only in that they 
have different dependencies, both of which have been previously rejected. Therefore, 
prior art applies. 

32. Claims 100-103 are rejected for the same reasons as claims 2-5, respectively. 
Thus, the arguments analogous to that presented above for claims 2-5 are equally 
applicable to claims 100-103. Claims 100-103 distinguishes from claims 2-5 only in that 
they have different dependencies, both of which have been previously rejected. 
Therefore, prior art applies. 

33. Claims 6 and 46 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Takei (as modified by Yamaguchi and Bedell et al) as applied to claims 5, 45, 89 and 

1 03 above, and further in view of U.S. Patent No. 200301 23751 (Krishnamurthy et al). 

34. Regarding claim 6, Takei (as modified by Yamaguchi and Bedell et al) discloses 
all of the claimed elements as set forth above and incorporated herein by reference. 

Takei (as modified by Yamaguchi and Bedell et al) does not disclose expressly 
that the selected portion further comprises a zoom region, and a new image comprising 
a zoomed image includes the face enlarged by zooming. 

Krishnamurthy et al discloses a selected portion, or the region of interest (fig. 2, 
item 210), further comprises a zoom region, since the region of interest is zoomed in on, 
(fig. 2, item 240), and a new image comprising a zoomed image includes the face 
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enlarged by the zooming (fig. 2, item 240), since the face is included in the region of 
interest (pg. 1, pp. 0009). 

Takei (as modified by Yamaguchi and Bedell et al) and Krishnamurthy et al are 
combinable because they are from the same field of endeavor, i.e. facial image 
processing. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to have the capability of zooming in on the face. 

The suggestion/motivation for doing so would have been more robust system by 
allowing images to be taken from far away. 

Therefore, it would have been obvious to combine Takei (as modified by 
Yamaguchi and Bedell et al) with the zooming of Krishnamurthy et al to obtain the 
invention as specified in claim 6. 

35. Claim 46 is rejected for the same reasons as claim 6. Thus, the arguments 
analogous to that presented above for claim 6 are equally applicable to claim 46. Claim 
6 distinguishes from claim 46 only in that they have different dependencies, both of 
which have been previously rejected. Therefore, prior art applies. 

36. Claim 90 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei in 
view of Yamaguchi and Bedell et al, as applied to claim 89 above, and further in view of 
U.S. Patent No.6246779 (Fukui et al). 

Regarding claim 90, Takei (as modified by Yamaguchi and Bedell et al) discloses 
all of the claimed elements as set forth above, and incorporated herein by reference. 
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Takei (as modified by Yamaguchi and Bedell et al) does not disclose expressly 
determining a point of rotation and an amount of rotation after which another image is 
automatically generated including a rotated version of the face. 

Fukui et al discloses determining a point of rotation, a rotation pivot point (col. 7, 
line 31) and an amount of rotation theta (col. 7, line 40) after which another image is 
automatically generated including a rotated, transformed version of the face (col. 7, 
lines 41- col. 8, line 4). 

Takei (as modified by Yamaguchi and Bedell et al) and Fukui et al are 
combinable because they are from the same field of endeavor, i.e. facial image 
processing. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to rotate the face. 

The suggestion/motivation for doing so would have been to provide a more user- 
friendly system by providing a means to obtain a normalized version of the face which 
can be used in more effectively in many applications such as image matching, or simply 
be used as a better fit to the display. 

Therefore, it would have been obvious to combine the method of Takei (as 
modified by Yamaguchi and Bedell et al) with the rotation of Fukui et al to obtain the 
invention as specified in claim 90. 



37. Claim 104 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei 
in view of Yamaguchi, and further in view of Fukui. 
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Regarding claim 104, Takei (as modified by Yamaguchi) discloses all of the 
claimed elements as set forth above, and incorporated herein by reference. 

Takei (as modified by Yamaguchi) does not disclose expressly determining a 
point of rotation and an amount of rotation such that the generating of the values of the 
pixels automatically generates a new image including a rotated version of the face by 
rotating the image about said point of rotation by said amount of rotation. 

Fukui et al discloses a step of determining a point of rotation, a rotation pivot 
point (col. 7, line 31 ) and an amount of rotation theta (col. 7, line 40) such that the 
generating of the values of the pixels automatically generates a new image, a 
transformed version of the face, including a rotated version of the face by rotating the 
image about said point of rotation by said amount of rotation (col. 7, lines 41- col. 8, line 
4. 

Takei (as modified by Yamaguchi) and Fukui et al are combinable because they 
are from the same field of endeavor, i.e. facial image processing. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to rotate the face. 

The suggestion/motivation for doing so would have been to provide a more user- 
friendly system by providing a means to obtain a normalized version of the face which 
can be used in more effectively in many applications such as image matching, or simply 
be used as a better fit to the display. 
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Therefore, it would have been obvious to combine the method of Takei (as 
modified by Yamaguchi) with the rotation of Fukui et al to obtain the invention as 
specified in claim 104. 

38. Claims 7, 11, 47 and 51 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Takei (in view of Yamaguchi, Bedell et al, and Krishnamurthy et al) 
and further in view of Fukui. 

39. Claims 7 and 47 are rejected for the same reasons as claim 90. Thus, the 
arguments analogous to that presented above for claim 90 are equally applicable to 
claims 7 and 47. Claims 7 and 47 distinguish from claim 90 only in that they have 
different dependencies, all of which have been previously rejected. Therefore, prior art 
applies. 

40. Claims 11 and 51 are rejected for the same reasons as claim 104. Thus, the 
arguments analogous to that presented above for claim 104 are equally applicable to 
claims 1 1 and 51 . Claims 1 1 and 51 distinguish from claim 104 only in that they have 
different dependencies, all of which have been previously rejected. Therefore, prior art 
applies. 

41 . Claim 81 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei in 
view of Krishnamurthy. 

42. Takei discloses all of the claimed elements as set forth above and incorporated 
herein by reference. 
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Takei does not disclose expressly the one or more new still images comprise a 
plurality of new still images; Takei only adjusts the one image regarding the facial 
exposure. 

Krishnamurthy et al discloses another new image that can be generated from a 
selected portion, or the region of interest (fig. 2, item 210), comprising a zoom region, 
since the region of interest is zoomed in on, (fig. 2, item 240), and a new image 
comprising a zoomed image includes the face enlarged by the zooming (fig. 2, item 
240), since the face is included in the region of interest (pg. 1 , pp. 0009). With the 
additional zooming of Krishnamurthy, a plurality of images are generated. 

Takei and Krishnamurthy et al are combinable because they are from the same 
field of endeavor, i.e. facial image processing. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to have the capability of zooming in on the face in addition to exposure 
compensation. 

The suggestion/motivation for doing so would have been more robust system by 
allowing images to be taken from far away. 

Therefore, it would have been obvious to combine the method of exposure 
compensation of Takei with the zooming of Krishnamurthy to obtain the invention as 
claimed in claim 81 . 

43. Claim 82 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei in 
view of Simon, as applied to claim 23 above, and further in view of Krishnamurthy et al. 
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Claim 82 is rejected for the same reasons as claim 81 . Thus, the arguments analogous 
to that presented above for claim 81 are equally applicable to claim 82. Claim 82 
distinguishes from claim 81 only in that they have different dependencies, both of which 
have been previously rejected. Therefore, prior art applies. 

44. Claim 83 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei in 
view of Yamaguchi, as applied to claim 41 above, and further in view of Krishnamurthy 
et al. Claim 83 is rejected for the same reasons as claim 81 . Thus, the arguments 
analogous to that presented above for claim 81 are equally applicable to claim 83. 
Claim 83 distinguishes from claim 81 only in that they have different dependencies, both 
of which have been previously rejected. Therefore, prior art applies. 

45. Claims 84 and 112 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Yamaguchi and Simon, as applied to claim 63 above, and further 
in view of Krishnamurthy et al. 

Claims 84 and 1 12 are rejected for the same reasons as claim 81 . Thus, the arguments 
analogous to that presented above for claim 81 are equally applicable to claims 84 and 
1 1 2. Claims 84 and 1 1 2 distinguishes from claim 81 only in that they have different 
dependencies, both of which have been previously rejected. Therefore, prior art 
applies. 
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46. Claim 105 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei 
in view of Yamaguchi, as applied to claim 99 above, and further in view of U.S. Patent 
Application Publication No. 20030142209 (Yamazaki et al). Takei (as modified by 
Yamaguchi) all of the claimed elements as set forth above and incorporated herein by 
reference. 

Takei (as modified by Yamaguchi) does not disclose expressly generating a 
panning sequence comprising a sequence of at least two of the original image and the 
one or more new images. 

Yamazaki et la discloses generating of the values by generating one or more 
new images (fig. 2, items 3-3 to 3-5) each including a new group of pixels corresponding 
to the face, the face being shown in fig. 2, items 3-3 to 3-5 and the new group of pixels 
being the changes in the face in the new images, and further comprising the step of 
generating a panning sequence (pg. 2, pp. 21) which keeps the object of interest in the 
center, comprising a sequence of at least two of the original images (fig. 3, items 3-2 to 
3-3) and the one or more new images (fig. 3-4). 

Takei (as modified by Yamaguchi) and Yamazaki et al are combinable because 
they are from the same field of endeavor, i.e. facial image processing. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to pan in new images. 

The suggestion/motivation for doing so would have been to provide a more user- 
friendly system by automatically following an object of interest instead of manually 
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following, and to increase speed by following the object instead of asking the user to 
find the object when it moves. 

Therefore, it would have been obvious to combine the method of Takei (as 
modified by Yamaguchi) with Yamazaki et al to obtain the invention as specified in claim 
105. 

47. Claim 91 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei in 
view of Yamaguchi and Bedell et al, and further in view of Yamazaki et al. 

Takei (as modified by Yamaguchi and Bedell et al) discloses all of the claimed 
elements as set forth above and incorporated herein by reference. 

Takei (as modified by Yamaguchi and Bedell et al) does not disclose expressly 
(g) determining one or more further new images each including a new group of pixels 
corresponding to the face; and (h) automatically panning using the one or more further 
new images. 

Yamazaki et al discloses determining one or more further new images each 
including a new group of pixels corresponding to the face by obtaining more images 
over time that include the face (fig. 3, item 3-3 to 3-5). And automatically panning using 
one or more further new images, as can be seen in items 3.3 to 3.5, since the person 
moves and the camera keeps the person in the center, thus panning (pg. 2, pp. 21). 

Takei (as modified by Yamaguchi and Bedell et al) and Yamazaki et al are 
combinable because they are from the same field of endeavor, i.e. facial image 
processing. 
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At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to pan in new images. 

The suggestion/motivation for doing so would have been to provide a more user- 
friendly system by automatically following an object of interest instead of manually 
following, and to increase speed by following the object instead of asking the user to 
find the object when it moves. 

Therefore, it would have been obvious to combine the method of Takei (as 
modified by Yamaguchi and Bedell et al) with Yamazaki et al to obtain the invention as 
specified in claim 91. 

48. Claims 8, 9, 14-15, 48, 49, 54 and 55 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Takei, Yamaguchi, Bedell and Krishnamurthy and further in 
view of Yamazaki et al. 

49. Claims 8 and 14 are rejected for the same reasons as claims 91 and 105, 
respectively. Thus, the arguments analogous to that presented above for claims 91 and 
105 are equally applicable to claims 8 and 14. Claims 8 and 14 distinguish from claims 
91 and 105 only in that they have different dependencies, both of which have been 
previously rejected. Therefore, prior art applies. 

50. Claims 48 and 54 are rejected for the same reasons as claims 91 and 105, 
respectively. Thus, the arguments analogous to that presented above for claims 91 and 
105 are equally applicable to claims 48 and 54. Claims 48 and 54 distinguish from 
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claims 91 and 105 only in that they have different dependencies, both of which have 
been previously rejected. Therefore, prior art applies. 

51 . Regarding claim 9, Yamazaki et al discloses each of the one or more further new 
images including pixels corresponding to features different from at least one other 
image of the one or more further new images, such features being the differences in the 
image from movement, such as the movement of the door and the pixels corresponding 
to the movement (fig. 3, items 3-2 to 3-5). 

52. Claims 1 5, 49, and 55 are rejected for the same reasons as claim 9. Thus, the 
arguments analogous to that presented above for claim 9 are equally applicable to 
claims 15, 49, and 55. Claims 15, 49, and 55 distinguish from claim only in that they 
have different dependencies, all of which have been previously rejected. Therefore, 
prior art applies. 

53. Claims 10, 12, 13, 50, 52 and 53 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Takei (as modified by of Yamaguchi, Bedell et al and Krishnamurthy) 
and further in view of Yamazaki, as applied to claims 8 and 48 and Fukui et al, as 
applied to claims 1 1 and 51 . 

Regarding claim 10, Takei (as modified by of Yamaguchi, Bedell et al, 
Krishnamurthy and Yamazaki) discloses all of the claimed elements as set forth above, 
and incorporated herein by reference. 

Takei (as modified by of Yamaguchi, Bedell et al, Krishnamurthy and Yamazaki) 
does not disclose expressly determining a point of rotation and an amount of rotation 



Application/Control Number: 10/608,784 Page 23 

Art Unit: 2624 

after which another image is automatically generated including a rotated version of the 
face. 

Fukui et al discloses determining a point of rotation, a rotation pivot point (col. 7, 
line 31) and an amount of rotation theta (col. 7, line 40) after which another image is 
automatically generated including a rotated, transformed version of the face (col. 7, 
lines 41- col. 8, line 4). 

Takei (as modified by of Yamaguchi, Bedell et al, Krishnamurthy and Yamazaki) 
and Fukui et al are combinable because they are from the same field of endeavor, i.e. 
facial image processing. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to rotate the face. 

The suggestion/motivation for doing so would have been to provide a more user- 
friendly system by providing a means to obtain a normalized version of the face which 
can be used in more effectively in many applications such as image matching, or simply 
be used as a better fit to the display. 

Therefore, it would have been obvious to combine the method of Takei (as 
modified by of Yamaguchi, Bedell et al, Krishnamurthy and Yamazaki) with Fukui et al 
to obtain the invention as specified in claim 10. 

54. Claim 50 is rejected for the same reasons as claim 10. Thus, the arguments 
analogous to that presented above for claim 10 are equally applicable to claim 50. 
Claim 50 distinguishes from claim 10 only in that they have different dependencies, both 
of which have been previously rejected. Therefore, prior art applies. 
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55. Regarding claim 12, Takei (as modified by Yamaguchi, Bedell, Krishnamurthy 
and Fukui) discloses all of the claimed elements as set forth above, and incorporated 
herein by reference. Takei (as modified by Yamaguchi, Bedell, Krishnamurthy and 
Fukui) does not disclose expressly (d) determining one or more further new images 
each including a new group of pixels corresponding to the face; and (e) automatically 
panning using the one or more further new images. Yamazaki et al discloses 
determining one or more further new images each including a new group of pixels 
corresponding to the face by obtaining more images over time that include the face (fig. 
3, item 3-3 to 3-5). And automatically panning using one or more further new images, as 
can be seen in items 3.3 to 3.5, since the person moves and the camera keeps the 
person in the center, thus panning (pg. 2, pp. 21). Takei (as modified by Yamaguchi, 
Bedell, Krishnamurthy and Fukui) and Yamazaki et al are combinable because they are 
from the same field of endeavor, i.e. facial image processing. At the time of the 
invention, it would have been obvious to a person of ordinary skill in the art to pan in 
new images. The suggestion/motivation fordoing so would have been to provide a more 
user-friendly system by automatically following an object of interest instead of manually 
following, and to increase speed by following the object instead of asking the user to 
find the object when it moves. Therefore, it would have been obvious to combine the 
method of Takei (as modified by Yamaguchi, Bedell, Krishnamurthy and Fukui) with 
Yamazaki et al to obtain the invention as specified in claim 12. 

56. Claim 52 is rejected for the same reasons as claim 12. Thus, the arguments 
analogous to that presented above for claim 12 are equally applicable to claim 52. 
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Claim 52 distinguishes from claim 10 only in that they have different dependencies, both 
of which have been previously rejected. Therefore, prior art applies. 

57. Claims 13 and 53 are rejected for the same reasons as claim 9. Thus, the 
arguments analogous to that presented above for claim 9 are equally applicable to 
claims 13 and 53. Claim 13 and 53distinguish from claim 9 only in that they have 
different dependencies, all of which have been previously rejected. Therefore, prior art 
applies. 

58. Claims 32, 33, and 98 rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Simon, as applied to claims 23 and 92 above, and further in view 
of Yamazaki et al. 

59. Claims 32 and 98 are rejected for the same reasons as claim 14. Thus, the 
arguments analogous to that presented above for claim 1 4 are equally applicable to 
claims 32 and 98. Claims 32 and 98 distinguish from claim 14 only in that claims 32 
and 98 provide options for continuing processing. Simon teaches further this feature, as 
discussed above. 

60. Claim 33 is rejected for the same reasons as claim 9. Thus, the arguments 
analogous to that presented above for claim 9 are equally applicable to claim 33. Claim 
33 distinguishes from claim 9 only in that they have different dependencies, all of which 
have been previously rejected. Therefore, prior art applies. 
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61. Claims 72, 73, 110 and 111 are rejected under 35 U.S.C. 103(a) as being 
unpatentable overTakei in view of Yamaguchi and Simon, as applied to claims 63 and 
101 above, and further in view of Yamazaki et al. 

62. Claims 72 and 110 are rejected for the same reasons as claim 14. Thus, the 
arguments analogous to that presented above for claim 14 are equally applicable to 
claims 72 and 110. Claims 72 and 1 10 distinguish from claim 14 only in that claims 72 
and 110 provide options for continuing processing. Simon teaches further this feature, 
as discussed above. 

63. Claims 73 and 111 are rejected for the same reasons as claim 9. Thus, the 
arguments analogous to that presented above for claim 9 are equally applicable to 
claims 73 and 111. Claims 73 and 1 1 1 distinguish from claim only in that they have 
different dependencies, all of which have been previously rejected. Therefore, prior art 
applies. 

64. Claims 29 and 96 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei (as modified by Simon), as applied to claims 23 and 92 above, and further in 
view of Fukui. 

65. Claims 29 and 96 are rejected for the same reasons as claim 1 1 . Thus, the 
arguments analogous to that presented above for claim 1 1 are equally applicable to 
claims 29 and 96. Claims 29 and 96 distinguishes from claim 1 1 only in that claims 29 
and 96 provide an option to generate a new image. Simon teaches further this feature, 
as discussed above. 
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66. Claims 69 and 107 are rejected under 35 U.S.C. 103(a) as being unpatentable 
overTakei in view of Yamaguchi and Simon, as applied to claims 63 and 101 above, 
and further in view of Fukui. 

67. Claims 69 and 1 07 are rejected for the same reasons as claim 1 1 . Thus, the 
arguments analogous to that presented above for claim 1 1 are equally applicable to 
claims 69 and 107. Claims 69 and 107 distinguishes from claim 1 1 only in that claims 
69 and 107 provide an option to generate a new image. Simon teaches further this 
feature, as discussed above. 

68. Claims 30-31 and 97 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Simon and Fukuii, as applied to claims 23 and 92 above, and 
further in view of Yamazaki et al. 

69. Claims 30 and 97 are rejected for the same reasons as claim 1 2. Thus, the 
arguments analogous to that presented above for claim 1 2 are equally applicable to 
claims 30 and 97. Claims 30 and 97distinguishes from claim 12 only in that claims 30 
and 97 provide options for continuing processing. Simon teaches further this feature, as 
discussed above. 

70. Claim 31 is rejected for the same reasons as claim 9. Thus, the arguments 
analogous to that presented above for claim 9 are equally applicable to claim 31 . Claim 
31 distinguishes from claim 9 only in that they have different dependencies, all of which 
have been previously rejected. Therefore, prior art applies. 
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71. Claims 70-71 and 108-109 are rejected under 35 U.S.C. 103(a) as being 
unpatentable overTakei in view of Yamaguchi and Simon, as applied to claims 63 and 
101 above, and further in view of Yamazaki et al. 

72. Claims 70 and 1 08 are rejected for the same reasons as claim 12. Thus, the 
arguments analogous to that presented above for claim 12 are equally applicable to 
claims 70 and 108. Claims 70 and 108distinguishes from claim 12 only in that claims 70 
and 108 provide options for continuing processing. Simon teaches further this feature, 
as discussed above. 

73. Claims 71 and 1 09 are rejected for the same reasons as claim 9. Thus, the 
arguments analogous to that presented above for claim 9 are equally applicable to 
claims 71 and 1 09. Claims 71 and 1 09 distinguish from claim 9 only in that they have 
different dependencies, all of which have been previously rejected. Therefore, prior art 
applies. 

74. Claims 24 and 93 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Simon, as applied to claims 23 and 92 above, and further in view 
of Krishnamurthy et al. 

75. Claims 24 and 93 are rejected for the same reasons as claim 6. Thus, the 
arguments analogous to that presented above for claim 6 are equally applicable to 
claims 24 and 93. Claims 24 and 93 distinguish from claim 6 only in that they have 
different dependencies, both of which have been previously rejected. Therefore, prior 
art applies. 
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76. Claim 64 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei in 
view of Yamaguchi and Simon, as applied to claim 63 above, and further in view of 
Krishnamurthy et al. 

77. Claim 64 is rejected for the same reasons as claim 6. Thus, the arguments 
analogous to that presented above for claim 6 are equally applicable to claim 64. Claim 
64 distinguishes from claim 6 only in that they have different dependencies, both of 
which have been previously rejected. Therefore, prior art applies. 

78. Claims 25 and 94 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Simon and Krishnamurthy, as applied to claims 24 and 93 above, 
and further in view of Fukui. 

79. Claims 25 and 94 are rejected for the same reasons as claim 7. Thus, the 
arguments analogous to that presented above for claim 7 are equally applicable to 
claims 25 and 94. Claims 25 and 94 distinguish from claim 7 only in that they have 
different dependencies, both of which have been previously rejected. Therefore, prior 
art applies. 

80. Claim 65 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei in 
view of Yamaguchi, Simon and Krishnamurthy, as applied to claim 64 above, and 
further in view of Fukui. 
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81 . Claim 65 is rejected for the same reasons as claim 7. Thus, the arguments 
analogous to that presented above for claim 7 are equally applicable to claim 65. Claim 
65 distinguishes from claim 7 only in that they have different dependencies, both of 
which have been previously rejected. Therefore, prior art applies. 

82. Claims 26, 27 and 95 are rejected under 35 U.S.C. 1 03(a) as being unpatentable 
over Takei in view of Simon and Krishnamurthy, as applied to claims 24 and 93 above, 
and further in view of Yamazaki et al. 

83. Claims 26 and 95 are rejected for the same reasons as claim 8. Thus, the 
arguments analogous to that presented above for claim 8 are equally applicable to 
claims 26 and 95. Claims 26 and 95 distinguishes from claim 8 only in that claims 26 
and 95 provide options for continuing processing. Simon teaches further this feature, as 
discussed above. 

84. Claim 27 is rejected for the same reasons as claim 9. Thus, the arguments 
analogous to that presented above for claim 9 are equally applicable to claim 27. Claim 
27 distinguishes from claim 9 only in that they have different dependencies, all of which 
have been previously rejected. Therefore, prior art applies. 

85. Claims 66 and 67 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Yamaguchi, Simon and Krishnamurthy, as applied to claims 64 
above, and further in view of Yamazaki et al. 
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86. Claim 66 is rejected for the same reasons as claim 8. Thus, the arguments 
analogous to that presented above for claim 8 are equally applicable to claim 66. Claim 

66 distinguishes from claim 8 only in that claim 66 provides options for continuing 
processing. Simon teaches further this feature, as discussed above. 

87. Claim 67 is rejected for the same reasons as claim 9. Thus, the arguments 
analogous to that presented above for claim 9 are equally applicable to claim 67. Claim 

67 distinguishes from claim 9 only in that they have different dependencies, all of which 
have been previously rejected. Therefore, prior art applies. 

88. Claim 28 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei, 
Simon, Krishnamurthy and Yamazaki as applied to claim 26 above, and further in view 
of Fukui. 

89. Claim 28 is rejected for the same reasons as claim 10. Thus, the arguments 
analogous to that presented above for claim 10 are equally applicable to claim 28. 
Claim 28 distinguishes from claim 10 only in that they have different dependencies, all 
of which have been previously rejected. Therefore, prior art applies. 

90. Claim 68 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei, 
Yamaguchi, Simon, Krishnamurthy and Yamazaki as applied to claims 26 and 66 
above, and further in view of Fukui. 

91 . Claim 68 is rejected for the same reasons as claim 1 0. Thus, the arguments 
analogous to that presented above for claim 10 are equally applicable to claim 68. 
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Claim 68 distinguishes from claim 10 only in that they have different dependencies, all 
of which have been previously rejected. Therefore, prior art applies. 

Conclusion 

92. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to KATHLEEN S. YUAN whose telephone number is 
(571 )272-2902. The examiner can normally be reached on Monday to Thursdays, 9 AM 
to 5 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Bhavesh Mehta can be reached on (571)272-7453. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Bhavesh M Mehta/ 

Supervisory Patent Examiner, Art Unit 2624 



/Kathleen S Yuan/ 
Examiner, Art Unit 2624 
10/30/2009 



